Stochastic and substochastic solutions for infinite-state Markov chains with applications to matrix-analytic methods
نویسندگان
چکیده
منابع مشابه
Revisiting Weak Simulation for Substochastic Markov Chains
The spectrum of branching-time relations for probabilistic systems has been investigated thoroughly by Baier, Hermanns, Katoen and Wolf (2003, 2005), including weak simulation for systems involving substochastic distributions. Weak simulation was proven to be sound w. r. t. the liveness fragment of the logic PCTL\X , and its completeness was conjectured. We revisit this result and show that sou...
متن کاملThe complexity of analyzing infinite-state Markov chains, Markov decision processes, and stochastic games (Invited talk)
In recent years, a considerable amount of research has been devoted to understanding the computational complexity of basic analysis problems, and model checking problems, for finitelypresented countable infinite-state probabilistic systems. In particular, we have studied recursive Markov chains (RMCs), recursive Markov decision processes (RMDPs) and recursive stochastic games (RSGs). These aris...
متن کاملModel Checking Infinite-State Markov Chains
In this paper algorithms for model checking CSL (continuous stochastic logic) against infinite-state continuous-time Markov chains of so-called quasi birth-death type are developed. In doing so we extend the applicability of CSL model checking beyond the recently proposed case for finite-state continuous-time Markov chains, to an important class of infinite-state Markov chains. We present synta...
متن کاملPerturbations of Markov Chains with Applications to Stochastic Games
In this lecture we will review several topics that are extensively used in the study of n-player stochastic games. These tools were used in the proof of several results on non zero-sum stochastic games. Most of the results that are presented here appeared in Vieille (1997a,b), and some appeared in Solan (1998, 1999). The first main issue is Markov chains where the transition rule is a Puiseux p...
متن کاملInfinite Level-dependent Qbd Processes and Matrix-analytic Solutions for Stochastic Chemical Kinetics
Systems of stochastic chemical kinetics are modeled as infinite level-dependent quasibirth-and-death (LDQBD) processes. For these systems, in contrast to many other applications, levels have an increasing number of states as the level number increases and the probability mass may reside arbitrarily far away from lower levels. Ideas from Lyapunov theory are combined with existing matrix-analytic...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Advances in Applied Probability
سال: 2008
ISSN: 0001-8678,1475-6064
DOI: 10.1017/s0001867800003001